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(54) METHOD AND APPARATUS FOR DIGITAL WATERMARKING AND 
WATERMARK DECODING 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a method for protecting a digital movie 
against copying without permission. 

SOLUTION: The method for embedding a watermark in the digital movie includes; 
temporarily storing portions of an electronic digital representation of the digital 
movie in at least one digital representation domain; embedding an electronic 
watermark in at least one of the stored digital representation domain of the movie; 
and presenting portions of the digital movie while the embedding is occurring. 
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CLAIMS 



[Claim(s)] 
[Claim 1] 

It is the approach of embedding a watermark on a digital movie, 

A part of electronic digital representation of a digital movie is temporarily stored in 

at least one digital representation field, 

Digital watermarking is embedded to at least one stored digital representation field 
of the above-mentioned movie, 

The approach equipped with showing a part of above-mentioned digital movie during 
generating of the above-mentioned pad. 
[Claim 2] 

It is the approach according to claim 1 of being embedding the watermark which 
shows digital show equipment or a projector to a meaning, or shows the location of a 
theater to embed the above-mentioned watermark. 
[Claim 3] 

It is the approach according to claim 2 of being embedding the watermark which 
shows the location of a theater to embed the above-mentioned watermark. 
[Claim 4] 

Embedding the above-mentioned watermark is an approach according to claim 2 
further equipped with embedding the watermark which shows the show time of day 



of the above-mentioned movie. 
[Claim 5] 

It is the approach according to claim 4 of being embedding the above-mentioned 
watermark to two or more digital representation fields of the above-mentioned 
movie to embed a watermark to at least one digital representation field of the 
above-mentioned movie. 
[Claim 6] 

Two or more above-mentioned digital representation fields are approaches according 
to claim 5 which include the time domain and the frequency domain at least. 
[Claim 7] 

Embedding a watermark on the above-mentioned movie is an approach according to 
claim 2 further equipped with embedding a part of above-mentioned watermark over 
two or more frames of the above-mentioned movie. 
[Claim 8] 

The above-mentioned watermark is the approach according -to claim 7 of being 50 
bits or less. 
[Claim 9] 

It has that embedding the above-mentioned watermark generates human vision 
model JND[ of the image base which controls the reinforcement alpha of a 
watermark ] (x y) f <t) when using f <t) as the video frame of the above-mentioned 
movie. 

When frame with watermark f (t) spaces W and t is made into time of day, 

f<t) =f(t)+alpha(JND(x y) f <t)) W 

The approach according to claim 1 described. 

[Claim 10] 

It has that embedding the above-mentioned watermark generates human vision 
model JND[ of the image base which controls the reinforcement alpha of a 
watermark J (x y) f (t) when using f <t) as the video frame of the above-mentioned 
movie, 

When frame with watermark f <t) spaces time of day and W for t and makes gamma 
(t) the function of t, and the parameter corresponding to the weight of a watermark 
of alpha, 

f — (t) =f(t)+(gamma (t) x (1-VM (t))) x <alphax<JNO<x y) Kt)) x <W)) 
It is described, 

When delta is used into a parameter and VD "(t) is used as a three-dimensions video 
human-being model, it is the approach according to -claim 1 of being VM(t) =1 in 
VD(t) >delta, and being VM(t) =VD<t), when other. 
[Claim 11] 

It has that embedding the above-mentioned watermark generates human vision 
model JND[ of the image base which controls the reinforcement alpha of a 
watermark ] (x y) f (t) when using f (t) as the video frame of the above-mentioned 
movie, 



When making into the i-th scene the spread-spectrum watermark algorithm and Si 
which frame with watermark f (t) spaces W, and gamma it) is spaced through the 
function of t, it spaces FsS (W, Si) for every frame, and embed W and making alpha 
into a parameter, 

f — (t) =f(t)+gamma(t) x alphaxJND (x y) txFsS (W. Si) 
The approach according to claim 1 described. 
[Claim 12] 

It is an approach [ equipped with dividing into the segments SI, S2 SN of N 

individual which has Durations Ts1, Ts2 TsN, respectively based on the criteria 

beforehand chosen in the video-data stream of the above-mentioned movie, and 
changing a part of durations of the above-mentioned segment according to the 
watermark applied ] according to claim 1 to embed the above-mentioned watermark. 
[Claim 13] 

The approach according to claim 1 further equipped with asking for the origin/datum 
in the video image of the above-mentioned movie using the mass moment, and 
embedding a watermark in the location of the video frame on the basis of this 
****** origin/datum. 
[Claim 14] 

When making to ask for the reference point in the video image of the above- 
mentioned movie using the above-mentioned mass moment into dA=dxdy. making 
rho (ai) into the relative reinforcement of the specific color of Pixel ai and making 
gammai into the distance between the radix point of an image, and Pixel ai, 

[Equation 1] 
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and 

[Equation 2] 
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The approach according to claim 1 3 further equipped with asking for a new radix 
point, a second moment, and the Miyoshi moment using the relation described. 
[Claim 15] 

The approach according to claim 1 3 further equipped with embedding a key or a 
criteria object on the video frame of the above-mentioned movie, and forming a 
physical radix point. 
[Claim 16] 

Asking for the reference point in the video image of the above-mentioned movie is 
further equipped with asking for a criteria object, searching for the center of gravity 
for [ this ] criteria, and asking for the second moment and the Miyoshi moment for 
[ above-mentioned ] criteria, 

Embedding a watermark in the location of the video frame on the basis of the 
origin/datum for which it asked the account of a top is an approach according to 
claim 1 3 further equipped with choosing one or more watermark pad locations and 
one or more watermark pad reinforcement using the center of gravity, the second 
moment, and the Miyoshi moment for which it asked, and embedding a watermark by 
the reinforcement by which selection was made [ above-mentioned ] in the location 
by which selection was made [ above-mentioned ] the account of a top. 
[Claim 17] 

It is the approach of a publication to embed the above-mentioned watermark the 1st 
place of the claim which is embedding a watermark at both the voice of the above- 
mentioned digital movie, and video. 
[Claim 18] 

It is an approach [ equipped with asking for one / at least / digital signature of the 
voice stream of the above-mentioned digital movie, or a video stream, and 
embedding the digital signature of the above-mentioned stream at the stream of 
above-mentioned another side ] according to claim 1 to embed the above- 
mentioned watermark. 
[Claim 19] 

It is the approach according to claim 18 by which the digital signature of the above- 
mentioned voice stream is embedded at the above-mentioned video stream, and the 
digital signature of the above-mentioned video stream is embedded at the above- 
mentioned voice stream. 
[Claim 20] 

It is the approach according to claim 1 of being that the above-mentioned movie is 



compressed and the above-mentioned pad embeds a watermark at the compressed 
data of the above-mentioned movie. 
[Claim 21] 

Embedding a watermark at the compressed data of the above-mentioned movie is an 
approach according to claim 20 further equipped with modulating a quantization 
characteristic. 
[Claim 22] 

It is the approach of decrypting the movie by which the watermark was encoded, 
It asks for the location for [ in the video frame of a movie ] criteria, 
It asks for the center of gravity, the second moment, and the Miyoshi moment for 
[ above-mentioned ] criteria, 

The location of a watermark known in the distance in a movie is traced using the 
distance adjusted according to the location, the above-mentioned center of .gravity, 
the above-mentioned second moment, and the above-mentioned Miyoshi moment 
for [ above-mentioned ] criteria, 

An approach equipped with decrypting the watermark in the location of the above- 
mentioned watermark traced using the distance by which adjustment was carried out 
[ above-mentioned ]. 
[Claim 23] 

The approach according to claim 22 further equipped with searching for the patch 
configuration where the bit of a watermark was embedded using a private key K. 
[Claim 24] 

When making to ask for the center of gravity, the second moment, and the Miyoshi 
moment for [ above-mentioned ] criteria into dA=dxdy, making rho <ai) into the 
relative reinforcement of the specific color of Pixel ai and making-gammai into the 
distance between the radix point of an image, and Pixel ai, 
[Equation 3] 




and 



[Equation 4] 
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The approach according to claim 22 further equipped with asking for a new radix 
point, a second moment, and the Miyoshi moment using the relation described. 
[Claim 25] 

It is equipment which embeds a watermark on a digital movie, 

A part of electronic digital representation of a digital movie is temporarily stored in 
at least one digital representation field, 

Digital watermarking is embedded to at least one stored digital representation field 
of the above-mentioned movie, 

Equipment constituted so that a part of above-mentioned digital movie might be 
shown during generating of the above-mentioned pad. 
[Claim 26] 

The above-mentioned equipment is equipment according to claim 25 constituted so 
that the watermark which shows digital show equipment or a projector to a meaning, 
or shows the location of a theater may be embedded. 
[Claim 27] 

The above-mentioned equipment is equipment according to claim 26 -constituted so 
that the watermark which shows the location of a theater may be .embedded. 
[Claim 28] 

The above-mentioned equipment is equipment according to claim 26 constituted so 
that the watermark which shows the show time of day of the above-mentioned 
movie may be embedded. 
[Claim 29] 

The above-mentioned equipment is equipment according to claim 28 constituted so 
that the above-mentioned watermark may be embedded to two or more digital 
representation fields of the above-mentioned movie. 
[Claim 30] 

Two or more above-mentioned digital representation fields are equipment according 
to claim 29 which includes the time domain and the frequency domain at least. 
[Claim 31] 

The above-mentioned equipment is equipment according to claim -26 constituted -so 
that a part of above-mentioned watermark may be embedded over two or more 
frames of the above-mentioned movie. 
[Claim 32] 



The above-mentioned watermark is equipment according to claim 31 which is 50 bits 
or less. 
[Claim 33] 

In order to embed the above-mentioned watermark, the above-mentioned equipment 

is constituted so that human vision model JND[ of the image base which controls 

the reinforcement alpha of a watermark ] (x y) f <t) may be generated, when using f 

(t) as the video frame of the above-mentioned movie. 

When frame with watermark f (t) spaces W and t is made into time of day, 

f (t) =f(t)+alpha(JND<x y) f (t)) W 

Equipment according to claim 25 described. 

[Claim 34] 

In order to embed the above-mentioned watermark, the above-mentioned equipment 
is constituted so that human vision model JND[ of the image base which controls 
the reinforcement alpha of a watermark ] (x y) f <t) may be generated, when using f 
(t) as the video frame of the above-mentioned movie. 

When frame with watermark f <t) spaces time of day and W for t and makes ^amma 
(t) the function of t, and the parameter corresponding to the weight of a watermark 
of alpha, 

f — (t) =f<t)-Kgamma (t) x <1-VM<t))) x <alphax(JND(x y) f (t)) x tW)) 
It is described, 

When delta is used into a parameter and VD (t) is used as a three-dimensions video 
human-being model, it is equipment according to claim 25 which it is VM(t) =1 in 
VD(t) >delta. and is VM(t) =V£Xt) when other. 
[Claim 35] 

In order to embed the above-mentioned watermark, the above-mentioned equipment 
is constituted so that human vision model JND[ of the image base which controls 
the reinforcement alpha of a watermark ] {x y) fit) may be generated, when using f 
(t) as the video frame of the above-mentioned movie, 

When making into the i— th scene the spread-spectrum watermark algorithm and Si 
which frame with watermark f (t) spaces W, and gamma (t) is spaced through *he 
function of t. it spaces FsS (W, Si) for every frame, and embed W and making alpha 
into a parameter, 

f — (t) =f(t)+gamma(t) x alphaxJND (x y) txFsS <W. Si) 
Equipment according to claim 25 described. 
[Claim 36] 

In order to embed the above-mentioned watermark, it is the above-mentioned 
equipment, 

It divides into the segments S1, S2 SN of N individual which has Durations Ts1, 

Ts2 TsN, respectively based on the criteria beforehand chosen in the video-data 

stream of the above-mentioned movie, 

Equipment according to claim 25 constituted so that a part of durations of the 
above-mentioned segment may be changed according to the watermark applied. 



[Claim 37] 

The above-mentioned equipment is equipment according to claim 25 further 
constituted so that it may ask for the origin/datum in the video image of the above- 
mentioned movie using the mass moment and a watermark may be embedded in the 
location of the video frame on the basis of this ****** origin/datum. 
[Claim 38] 

In order to ask for the reference point in the video image of the above-mentioned 
movie using the above-mentioned mass moment, when making the above-mentioned 
equipment into dA=dxdy, making rho <ai) into the relative reinforcement of the 
specific color of Pixel ai and making gammai into the distance between the radix 
point of an image, and Pixel ai, 

[Equation 5] 
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and 

[Equation 6] 
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Equipment according to claim 37 further constituted using the relation described so 
that it may ask for a new radix point, a second moment, and the Miyoshi moment. 
[Claim 39] 

The above-mentioned equipment is equipment according to claim 37 further 
constituted so that a key or a criteria object may be -embedded on the video frame 
of the above-mentioned movie and a physical radix point may be formed. 



[Claim 40] 

In order to ask for the reference point in the video image of the above-mentioned 
movie, the above-mentioned equipment is further constituted so that it may ask for 
a criteria object, the center of gravity for [ this ] criteria may be searched for and it 
may ask for the second moment and the Miyoshi moment for [ above-mentioned ] 
criteria, 

In order to embed a watermark in the location of the video frame on the basis of the 
origin/datum for which it asked the account of a top, the above-mentioned 
equipment is equipment according to claim 37 which chooses one or more 
watermark pad locations and one or more watermark pad reinforcement using the 
center of gravity, the second moment, and the Miyoshi moment for which it asked, 
and is further constituted so that a watermark may embed by the reinforcement by 
which selection was made [ above-mentioned ] in the location by which selection 
was made [ above-mentioned ] the account of a top. 
[Claim 41] 

The above-mentioned equipment is equipment according to claim 25 -constituted so 
that a watermark may be embedded at both the voice of the above-mentioned 
digital movie, and video. 
[Claim 42] 

It is equipment according to claim 25 constituted so that the above-mentioned 
equipment may ask for one [ at least ] digital signature of the voice stream of the 
above-mentioned digital movie, or a video stream in order to embed the above- 
mentioned watermark, and the digital signature of the above-mentioned stream may 
be embedded at the stream of above-mentioned another side. 
[Claim 43] 

Equipment according to claim 42 constituted so that the digital signature of the 
above-mentioned voice stream may be embedded at the above-mentioned video 
stream and the digital signature of the above-mentioned video stream may be 
embedded at the above-mentioned voice stream. 
[Claim 44] 

Equipment according to claim 25 constituted so that a watermark may be embedded 
at the compressed data of the above-mentioned movie. 
[Claim 45] 

It is equipment according to claim 44 constituted so that the above-mentioned 
equipment may modulate a quantization characteristic in order to embed a 
watermark at the compressed data of the above-mentioned movie. 
[Claim 46] 

It is equipment which decrypts the movie by which the watermark was encoded, 
It asks for the location for [ in the video frame of a movie ] criteria, 
It asks for the center of gravity, the second moment, and the Miyoshi moment for 
[ above-mentioned ] criteria. 

The location of a watermark known in the distance in a movie is traced using the 



distance adjusted according to the location, the above-mentioned center of gravity, 
the above-mentioned second moment, and the above-mentioned Miyoshi moment 
for [ above-mentioned ] criteria, 

Equipment constituted so that the watermark in the location of the above- 
mentioned watermark traced using the distance by which adjustment was carried out 
[ above-mentioned ] may be decrypted. 
[Claim 47] 

Equipment according to claim 46 further constituted so that the patch configuration 
where the bit of a watermark was embedded may be searched for using a private 
key K. 
{Claim 48] 

In order to ask for the center of gravity, the second moment, and the Miyoshi 
moment for [ above-mentioned ] criteria, when making the above-mentioned 
equipment into dA=dxdy, making rho {ai) into the relative reinforcement of the 
specific color of Pixel ai and making gammai into the distance between the radix 
point of an image, and Pixel ai, 

[Equation 7] 
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and 

[Equation 8] 
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Equipment according to claim 46 further constituted using the relation described so 



that it may ask for a new radix point, a second moment, and the Miyoshi moment. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 

[Field of the Invention] 

[0001] 

About the detection approach of an unapproved copy, and equipment, this invention 
can be especially applied to the approach and equipment which protect digital 
contents from an unapproved copy, and a list, when the digital contents for [ the ] 
protection are the forms of a digital movie. 
[Background of the Invention] 
[0002] 

The interest is increasing in protecting digital contents from an unapproved -copy. 
Although it can protect by encryption till the moment of a show, digital contents will 
become brittle to unapproved use, if shown. One of the well-known approaches of 
protecting such a show object from unapproved use is embedding digital 
watermarking to digital contents. When giving a watermark to streaming-media 
contents, it can conceal so that he may not notice some information in media 
contents, and the information which judges the date, the time of day, and the 
location of the video voyeurism after decryptions, such as use of the video camera 
in a theater, can be offered. 
[0003] 

The unapproved digital copy approach is targetted for the well-known digital- 
watermarking technique. Since these techniques cannot bear a severe distortion 
which takes place when carrying out video tape recording of the digital playback 
movie using a video camera, when preventing or pursuing unapproved analog copies 
at the time of a show, such as a copy of the digital movie manufactured with the 
stock video camera, they are unapplicable ability. Furthermore, the approach of 
embedding little information in media is not suitable for digital-watermarking grant at 
the time of a show, when using it for protection of digital movie -contents. 
[0004] 

Conventionally, two or more data concealment techniques are known. One of the 
well-known techniques of data concealment is developed in Massachusetts Institute 
of Technology. "The information hiding which repulses an accidental forger 
(Information Hiding to Foil The Casual Counterfeiter)" incorporated in this 
specification in the form of a citation as it is, Information hiding -(Information Hiding), 
Lecture Notes Inn computer Science (LNCS), It is known in Berlin, "Springer— Verlag 
(Springer- Verlag), and 1988 as the 1525th volume and a p.1 "patchwork" algorithm. 



[ which was described by -15 by GURURU (Gruhl) and the vendor <Bender) ] After 
this algorithm chooses two or more "patches", it corrects and spaces that patch 
and changes embedded statistical distribution. A patch core is determined with 
reference to the die length of an image and height, and the pixel of immobilization, 
for example, the pixel of the [0, 0th] watch of an image. Although this system is 
satisfactory for an undistorted image, the image strain of rotation distortion, 
nonlinear distortion, etc. invites a decode error. 
[0005] 

Otherwise, many watermark algorithms are proposed. A general brittle digitaJ- 
watermarking algorithm modulates the least significant bit, spaces it through a least 
significant bit (LSB) stream, and embeds W. Although this watermark algorithm 
belongs to the easiest thing to carry out on real time, it may be blocked or cancelled 
by conversion of a certain kind and signal distortion. 
[0006] 

The spread-spectrum watermark algorithm is indicated by U.S. Pat. No. 5,848.155 { / 
else / cox /<Cox) ] incorporated in this specification in the form of a citation as it 
is. This algorithm serves as some foundations of the most general robust watermark 
algorithm. Although the advanced type of an algorithm besides this cox and its large 
number can bear a signal-processing noise {low-pass filtering, repressing, white- 
noise addition, etc.) of a certain kind, to DA-AO translation -(digital to analog 
conversion and subsequent analog-to-digital conversion) generated at the time of 
the copy by the video camera of a digital movie, a geometric image distortion, and 
large-scale contraction sampling conversion, it crawls on it similarly, it is wound and 
does not die. 
(0007] 

Furthermore, the watermark algorithm on a threshold effective in a digital movie is 
indicated by the United States patent application public presentation 2002nd of a 
name called "the equipment and the approach (Systems and method for -embedding 
a watermark signal that contains message data in a digital image)" containing 
message data of spacing and embedding a signal at a digital image for Jones <Jones) 
incorporated in this specification in the form of a citation as it is / No. 0106103. 
However, since it is the algorithm of the image base, if distortion, especially the 
geometric image distortion of various classes are received, this algorithm will also be 
so nice and it will not die. 
[0008] 

(Outline of invention) 

Therefore, in various modes of this invention, the approach of embedding a 
watermark on a digital movie is offered. This approach is equipped with showing a 
part of above-mentioned digital movie, performing **** during storing temporarily a 
part of electronic digital representation of a digital movie in at least one digital 
representation field, embedding digital watermarking to at least one stored digital 
representation field of the above-mentioned movie, and generating of the above- 



mentioned pad. 
[0009] 

Some modes of this invention offer the approach of decrypting the movie by which 
the watermark was encoded. This approach asks for the location for [ in the video 
frame of a movie ] criteria, It asks for the center of gravity, the second moment, and 
the Miyoshi moment for [ above-mentioned ] criteria. The location of a watermark 
known in the distance of a movie is traced using the distance adjusted according to 
the location, the above-mentioned center of gravity, the above-mentioned second 
moment, and the above-mentioned Miyoshi moment for [ above-mentioned ] criteria, 
It has decrypting the watermark in the location of the above-mentioned watermark 
traced using the distance by which adjustment was carried out [ above-mentioned ]. 
[0010] 

Still more nearly another embodiment of this invention offers the equipment which 
embeds a watermark on a digital movie. This equipment stores temporarily a part of 
electronic digital representation of a digital movie in at least one digital 
representation field, embeds digital watermarking to at least one stored digital 
representation field of the above-mentioned movie, and it is constituted so that a 
part of above-mentioned digital movie may be shown during generating of the 
above-mentioned pad. 
[0011] 

•Moreover, various modes of this invention offer the equipment which decrypts the 
movie by which the watermark was encoded. This equipment asks for the location 
for [ in the video frame of a movie ] criteria, asks for the center of gravity, the 
second moment, and the Miyoshi moment for [ above-mentioned ] criteria, and it is 
constituted so that the watermark in the location of the above-mentioned 
watermark which traced the location of a watermark known in the distance of a 
movie, and was traced using the distance by which adjustment was ^carried out 
[ above-mentioned ] decrypts using the distance adjusted according to the location, 
the above-mentioned center of gravity, the above-mentioned second moment, and 
the above-mentioned Miyoshi moment for [ above-mentioned ] criteria. 
[0012] 

When the pirate edition of video is discovered, a contents owner -can afford to spend 
most time amount on usually decrypting the embedded watermark. Therefore, 
although it is desirable for the mode of this invention (the exact time of day and the 
exact location of literary piracy can be pinpointed like) to embed a watermark on 
real time during the show of a movie, it is not necessarily required for the decryption 
approach and equipment to be usually close to it in being in agreement with a pad 
rate. 
[0013] 

The available field of further others of this invention will become clear from the 
following detailed explanation. Having the intention of them only for the purpose of 
instantiation, and not having the intention of them so that the range of this invention 



may be limited while the detailed explanation and detailed example show the 
desirable operation gestalt of this invention should be understood. 
[Best Mode of Carrying Out the Invention] 
[0014] 

He could understand this invention still more deeply with the detailed explanation 

and detailed drawing. 

[0015] 

It does not pass over explanation of the following desirable operation gestalten to 
instantiation in essence, and does not have the intention of limiting the range, 
application, and usage of this invention at all. 
[0016] 

While it sets in this specification and a video stream is reproduced or recorded on 
videotape, saying "a watermark is embedded on real time at a video stream", it 
points out that pad processing occurs, but though the playback or the image 
transcription rate of a video stream reproduced changes by the pad, a rate does not 
change, so that the consciousness of a pad is attained. "Time [ of a show ]"<on-the 
fly) The mode to embed is a mode embedded on real time. "Time [ of a show ]" 
Therefore, an example of the mode to embed is a mode which embeds a watermark 
at reproducing at the rate which meant the image transcription video stream, and 
coincidence at a video stream. 
[001 7] 

Various modes of this invention provide real time with the watermark in which a pad 
is possible at a compression video stream, having the pad ability of a high rate, and 
the severe resistance which receives distorted, especially — the voice of this 
invention — if it depends like, a video signal or an image is secret, for example — it 
is — it is — the resistance over a continuous distortion introduced by unapproved 
re-record is brought about. There is distortion caused by time amount conversion of 
digital-to-analog (DA) and analog digital (AD) conversion, repressing / transformer 
code conversion, the geometric conversion by slight rotation and slight <for example, 
the movie by which re-recording drawing is unjustly carried out with the video 
camera which the spectator carried in wins popularity) cropping and advanced scale 
conversion, color conversion, frame omission, a time amount jitter ring, etc. among 
such distortion. 
[0018] 

Various modes of this invention have a movie effective in pinpointing the location or 
the hall recorded on videotape unjustly. These modes and other various modes are 
enough if the embedded watermark includes the information which pinpoints a show 
day, show time of day, and a show location. If it assumes that the digital movie 
theater of 1 million exists, in order to store this information robustly to the movie of 
average die length, for example, the movie for about 90 minutes, many and about "50 
bits are enough. 20 about 5 thru/or 1 1 bits, and the show hall thru/or 24 bits are 
contained in showing show time of day in 1 5 bits which is equivalent to the 



embedded bit on for example, a show day, and precision sufficient for specification. 
In various modes, the show hall bit was assigned to the theater or consists of an 
identification number of the meaning assigned to digital show equipment or a 
projector. 
[0019] 

In some modes of this invention, watermark W consists of P segment W= {W1 , W2 

WP}, and is embedded in the host video V. For example, W1 expresses the location 
and/or other identifiers of a digital movie theater, and W2 is spaced and attached 
and expresses the show time of day of a work. Furthermore, V is Q segment V={V1 , 

V2 VQ1} ={VQ 1+1, VQ 1+2 VQ2} = in one or more fields, such as a space field, 

a frequency domain, a time domain, and a bit field, and space. ... It consists of = 

{VQZ+1, VQZ+2 VQ-1, VQ}. W may contain further control data, such as 

synchronous data which support the extract of other watermark data, such as time- 
of-day data and location data. Thus, some modes of this invention support the 
multilayer pad of watermark data, namely 
V'=V+f(W) =V1+V'2+ ... +VQ1 (1) 
= VQ1+1+VQ1+2+ ... +VQ2 (2) 



= VQZ+1+VQZ+2+ ... +VQ-1+VQO) 
however 

QKQ2< ...<Qz<Q (4) 
Further, 

V'q=Vq+fq (Wq) (5) 

however 

{0020] 

{Equation 9] 
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fq is a function which becomes a known watermark function or this known 
specification from all the watermark function all [ one or more or ] of this invention 
of a publication. 
[0021] 

A watermark is divided into two segments W1 and W2 in one simple mode useful as 
an example. First, the video V which has ten shots is a time domain, and is divided 
into ten segments by the segmentation based on a shot. Next, V is divided into a 
frequency domain about the selected shots, such as a shot 2, a shot 4, and a shot 5. 
Each of these shots is further divided into a low frequency band segment, an 
intermediate frequency band segment, and a high-frequency band -segment, and is 



set to Q1=10. Q2-Q1=9. Q=10+9=19, q** [1, 19], p** [1, 2],j** [1, 2], and J< 2. 
Although this simple example is limited only to two-layer, it is natural in other modes 
of this invention. [ of it not being limited in this way ] 
[0022] 

In various modes, as shown in drawing 1 , the equipment 10 which -embeds a 
watermark at a digital video stream at a multilayer is equipped with the hall 
discrimination circuit 12 and the time clock 14. The hall discrimination circuit \2 is 
the serial number of the identifier of immobilization in the show hall which consists 
of 20 thru/or 24 bits, or the meaning of projection equipment. (In most modes, the 
operator or owner of equipment should not change the hall discrimination circuit 12 
easily.) The time clock 14 is the calender which generates a 15-bit date and 
sufficient time-of-day data of precision to specify the show of the movie. 5 [ for 
example, ], and 1 1 -bit data. 
[0023] 

The hall identifier which the hall discrimination circuit 12 outputs, and the time which 
the time clock 14 outputs are spaced by the watermark assembler 16, and is 
combined with a string. Although it is possible in some modes of equipment 10 to 
change a time stamp during the show of a movie, since movie start time and the hall 
location are enough in order to specify the hall and show time of day when the illegal 
copy of a movie was performed in many cases, only the time of day which a time 
clock outputs at the time of movie initiation is used in other modes of the watermark 
assembler 1 6. The watermark assembler 1 6 outputs collected watermark W by P 
segments, as mentioned above. If the last segment WP is outputted, an output will 
be resumed from the first segment W1 . The function fq of an above-mentioned 
segment (Wq) is called for, and it is stored in the watermark segment buffer 1 8. And 
a part of electronic digital representation of a digital movie is temporarily stored in 
at least one digital representation field. 
[0024] 

When the watermark segment is outputted and stored, another { by which the digital 
video source 20 outputs Segment Vi to the video segmentation buffer 22 ] parallel 
processing occurs. The time watermark pad module OA embeds the current 
watermark segment 18 at the current digital video segment transmitted by the video 
segmentation buffer 22. Then, it spaces, and a segment is changed by coding by the 
frequency conversion module 26, when for example, digital video is an incompressible 
format and the digital video by the reverse quantization conversion module 26 is an 
incompressible format, and it is attached and it is stored in the frequency-domain 
segment buffer 28. On the other hand, the frequency watermark pad module 34 and 
the spatial watermark pad module 44 embed the watermark segment which the 
segment buffer 18 transmits and corresponding <it passed through delay 30 
depending on the case) after the continuing conversion 26 and 36 at a current digital 
video segment. In some modes, delay 30 is performed so that the same watermark 
segment (or function which consists of one or more segments corresponding to it) 



as the pad module 24 may be embedded certainly at the segment to which the layer 
from which digital video differs by the pad modules 34 and 44 is equivalent. However, 
this correspondence relation is not needed for the mode of this invention being 
performed with the sufficient result by any means. A watermark segment pad which 
is different on the frame from which the segment from which digital video differs, 
respectively differs may be performed using a watermark pad algorithm different, 
respectively. For example, the video frame train of a frequency domain can be 
divided into a low frequency subband, an intermediate frequency subband, and a high 
frequency subband. You may space relatively the watermark segment which makes 
the highest robustness requirements, for example, and may also embed it at an 
intermediate frequency subband segment using a spread-spectrum watermark 
algorithm with low reinforcement. You may space and may also embed a segment at 
the segment of a high frequency subband using an another algorithm whose 
requirements for robustness are not more strong and which is -called for example, an 
effective-bits modulation. In order to embed a part or all of a watermark segment by 
modules 34 and 44, the human vision model 42 of a time domain, a space field, and a 
frequency domain is used. The video with a watermark of a frequency domain is 
changed by the module 36 after the pad in the pad module 34, and it is changed into 
a space field in order that a video-data train may embed the remaining part of a 
watermark to a space field by the module 44. Furthermore, it is used in order to 
space, to be attached and to display video on the theater digital display 38. A part of 
digital movie is shown by temporary storing at pad generating and coincidence. In 
other words, it can be considered that a pad carries out real time, i.e., the "time of 
show" generating. 
[0025] 

Although drawing 1 illustrates the mode of a two-layer pad, in other modes of this 
invention, he should adopt a monolayer pad and the multilayer pad in three or more 
fields, or it should also be understood that a different pad field from what is shown in 
drawing 1 is adopted. 
[0026] 

The conventional video digital- water marking technique using 2-dimensional <2D) 
watermark insertion can be used as a suitable watermark function fq in some modes 
of this invention. Each frame of video is treated as an image according to individual, 
and a watermark is embedded on each frame using the well-known image watermark 
technique constituted for static images. "Reinforcement" <namely, variation or 
change reinforcement of an image) of a watermark is controlled by human vision 
models, such as a JND Gust noticeable difference) model by the JPEG "(high loss 
joint photographic expert group specification for compression-ized 24-bit color 
picture storage format) compression algorithm. Therefore, when in the case of an 
image I is spaced and attached in a host (namely, input) image and I* {namely, output), 
an image and W are spaced and alpha is made into the scalar quantity -generated 
from JND, 



r=I+alphaW O) 
It becomes. 
[0027] 

In some modes of this invention, it acts on video input f <t), and spaces through 
video outlet f (t) using the conventional 2D watermark insertion technique described 
by the following equality, and W is inserted, 
f (t) =f(t)+alphaW (8) 
[0028] 

Here, it is used in order that each frame of video input f<t) may generate human 
vision model JND[ of the image base which controls watermark reinforcement ] (x y) 
f (t), and JND(x y) f (t) produces alpha, namely 
f(t) =Kt)+alpha(JND(x y) f <t)) W<9) 
[0029] 

Some modes of this invention use a new three-dimensions -(3D) watermark 
technique as an advanced type of the conventional 2D watermark insertion 
technique. In order to raise the robustness of a video watermark, specifically, the 
three-dimensions (3D) video human-being model HVM <x y. t) which is the function 
of JND (x y) and VD (t) is used. T is made into the duration of a time human-being 
vision model, a current video frame is the t-th frame, i.e., it is assumed that it is in 
time of day t. In some modes of this invention, the {t-betaT, t+<1-beta) T] frame 
which is the grand total of T is used, and the amount of distortion which can 
maintain a current video frame is derived. T can be derived from the statistical 
analyses of the time contrast sensitivity function of human being's vision defined 
using a heuristic function, and a series of test datas, and these -combination. It is 
there, 

f = (t-beta T t t+(1-beta) T} <10) 

At the time of ** 

VD (t) =g(f (0) =g (f <t-betaT) f <t) f <t+(1-beta) T))<1 1) 

It carries out. However, the function drawn from the time contrast sensitivity 
function of human being's vision defined using the heuristic function drawn when f <t) 
and g (t) analyzed statistically a series of test datas or a part of its combination, and 
beta are scalar quantity drawn with T. f (t). and g (t). In VD(t) >delta. it is described 
as VM(t) =1 . and except [ its ], if the function described to be VM(t) =VD(t) is 
defined, it will space through video using the relation described below, and W will be 
given. 
[0030] 

f — (t) =f(t)+(gamma (t) x (1-VM <t))) x(alphaxJND(x y) f <0) xW<12) 
However, alpha and delta are equivalent to a parameter with a selectable user, 
alpha<=1 is equivalent to the weight of digital watermarking, and -gamma <t) is the 
function of t with a selectable user. 
[0031] 

In some modes of this invention, when Si points out the i— th scene, the resistance of 



a watermark is further raised using the scene fluctuation function "F^W, Si). 
Therefore, it spaces through video using the relation described below, and W is -given. 
[0032] 

f — (t) =f(t)+(gamma (t) x (1-VM{t))) x(alphaxJND(x y) f<0) xF{W. Si) {13) 
[0033] 

The thing deformable [ like ] in equality 1 2 and equality 1 3 done to various 
requirements for various applications, such as choosing suitable alpha and suitable 
gamma (t), for the best fit is clear. For example, the time contrast sensitivity of a 
human visual system is the function of many not only other parameters but a motion 
vector rate and shot transition frequency. For example, the human visual system 
does not have the capacity to detect easily the artifact with which the duration of 
the middle shot Shot2 of three continuation shots Shotl, Shot2, and Shot3 is 
introduced into a high frequency field during the period of Shot2 when {, -such as ^two 
frame length, ] very short. In this case, a watermark can be embedded by high 
reinforcement during the period of Shot2 in a space field and a frequency domain. 
Therefore, as shown in drawing 2 , it is possible to set gamma <t) as 1 during the 
period of Shot2, namely, when it is t**Shot2, it is gamma(t) =1 and, probably alpha 
can be set up more highly than 1 . The high watermark robustness over the big 
distortion of various classes is introduced by these setup, without introducing a 
visible artifact into video. When Shot2 is a long shot, function gamma Kt) as shown in 
drawing 3 is more suitable. In this case, when a display frequency is very low, at the 
time of 0.1 -frame per second, by making it fall, after raising the reinforcement of 
digital watermarking slowly, the inter-frame vision artifact of "Shot2 will increase 
slowly, and will decrease in number. However, when the usual display frequency 
(about 24 thru/or 48-frame per second) is used, a visible artifact cannot be 
observed at all. In the simplified mode, using VTXt) =0, a constant alpha, and the 
space field (image base) JND function JND (x y) of the present frame t, it can space 
for every frame and W can be embedded from the spread-spectrum watermark 
algorithm Fss of the conventional technique. In the case of above both 
f — (t) =f(t)+gamma(t) x alphaxJNO <x y) txFss<W. Si) 
(14) 

It becomes. 
[0034] 

Therefore, as shown in drawing 1 , using the relation described by the relation 
described by equality 12 or equality 13, time watermark pad modules, such as the 
module 24 used for the equipment modes 10, such as a mode shown in a drawing, 
can be spaced through a video data V, and can embed W. 
[0035] 

As shown in drawing 4 , in some modes of this invention, it spaces through a video 
data and W is embedded by the time amount modulation. Although a time amount 
modulation is one time watermark pad mold at the point that a pad occurs with the 
time domain expression of a video signal, the time amount modulation differs from 



other time pad molds in that it changes according to digital watermarking to which 
the duration of a segment is applied. The video-data stream 41 is divided into the 

segments S1, S2 SN of N individual which has the durations Ts1, Ts2 TsN 

which correspond, respectively along with a time-axis based on preselected criteria. 
However, Ts=Ts1+Ts2+ ... At the time of +TsN, it is Vsq=VtSi+VtSj and they are 
Sq** [1, Q], Si, and Sj** [1, SN]. For example, the video stream 41 will be 
segmented by the division based on a scene on the shot boundary 43, and the 
segmentation buffer 22 of a pipeline mold will always store one shot or Segments SI, 

S2 SN for a modulation by it. After watermark grant is spaced, is attached and is 

different from the segments S1, S2 SN without a watermark of the original video 

stream 41 according to the watermark to which a part of durations of the segment 

S'1 of video stream 41', S'2 S'N are given. 

[0036] 

In order to space in the time watermark pad module 24 and to embed Bit w, Tsi and 

Tsj are changed as follows. About Key k 

[0037] 

[Equation 10] 
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[0038] 

It carries out. At TsKdelta and the time of w= 1 , it is T'si=Tsi+dekaT and T'sj=Tsj- 
deltaT and becomes T'si>=delta. On the other hand, at Tsi>delta and the time of w= 
0, it is T'si=Tsi-deltat and T'sj=Tsj+deltat and becomes T'si<=delta. Thereby, 
V'sq=Vsq+w is generated. Although one bit is embedded in this example using the 
modulation based on two shots (duration), of course, it is also possible by using the 
modulation of shot many to embed many bits by embedding one bit or using the 
modulation of two or more shots (duration). 
[0039] 

If it is defined as M=ts-T by video frame rate called the frame of ts individual per 

second, 

[0040] 

[Equation 11] 
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And it becomes t=delta-Tsi. Therefore, in order to embed the watermark bit of w= 1 , 
[0041] 

[Equation 12] 
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It reaches. 
[0042] 

[Equation 13] 
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At the time of ** 
fm=fm-ts-t (1 9) 
Come out and it is, 
[0043] 

[Equation 14] 
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At the time of ** 
[0044] 

[Equation 15] 
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Come out and it is, 
[0045] 

[Equation 16] 
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At the time of ** 
[0046] 

{Equation 17] 
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Suppose that it comes out. 
[0047] 

In some modes of this invention, a bit is embedded to a space field using a patch 
location. In the case of a three-dimensions <3D) pad, a watermark bit is embedded 
on two or more image frames of the video stream of a movie. One of the well-known 
approaches of embedding a watermark at a patch using the distance defined by the 
origin/datum is quoted above, and it is a "patchwork" watermark pad algorithm by 
GURURU (Gruhl) and the vendor {Bender) which were incorporated. 
[0048] 

For example, the expression with which the image shown in drawing 5 or the video 
frame 45 was simplified is considered. As shown in drawing 6 , a "patchwork" 
watermark pad module chooses one original pixel 46 <this example pixel of an upper 
left corner), two or more patch locations A1 and A2 for watermark bitpads, A3, and 
A4. Drawing 6 can be held and the watermark decryption module which the location, 
the patch locations A1 and A2, A3, and A4 of the original pixel 46 understand can 
take out the watermark embedded from the image or the video frame 45. 
[0049] 

However, when an image or the video frame 45 rotates, the location of the original 



pixel 46 will change and a decryption module will cause -confusion. For example, as 
shown in drawing 6 , the original pixel 46 assumes that it is located in the upper left 
corner of an image or the video frame 45. If the original pixel 46 is rotated 90 
degrees clockwise, it is located in the upper right corner of an image or the video 
frame 45 as shown in drawing 7 . If it is the conventional patchwork decoder, it 
assumes that pixel 46' is in the location of the upper left corner of drawing 7 , and 
patch location A1\ A2'. A3', and A4' will be spaced, and it will be assumed that it is a 
location for pads. Thus, if it assumes, a decryption will go wrong. When an image is 
geometrically changed by rotation, expanding, compression, etc., the original pixel 46 
is moving or it may have separated from it from the screen. Therefore, the location 
of a watermark is also changing to the original pixel set up before geometric 
modification. Furthermore, when the image is carrying out scale change, even if the 
original pixel is not changing, the location of a watermark changes. 
[0050] 

In some modes of this invention, in order to raise the robustness over distortion of 
video, the reference point in a video image is determined using the mass moment. 
For example, the mass moment is used as an origin/datum and some modes of this 
invention define the distance of a "patchwork" watermark pad algorithm. Other 
watermark algorithms which can be changed are suitable for the mode of this 
invention so that a reference point and/or a geometry may be determined using the 
mass moment. 
[0051] 

The mass moment is used and the distance by the relative unit length based on an 
object is defined. Although a radix point is set up on the basis of the object in an 
image, the above-mentioned object does not necessarily need to be in the border 
area of an image. Therefore, even if two or more pixels of the border area of an 
image are removed from a screen, a radix point does not change. Furthermore, the 
unit length of distance is not immobilization and is relative. Therefore, if the scale of 
an image changes, since the scale of unit length will also -change according to it, 
digital watermarking can be traced eternally. 
[0052] 

It considers as dA=dxdy, rho (ai) is made into the relative reinforcement of the 
specific color of Pixel ai, and gammai is made into the distance between the radix 
point of an image, and Pixel ai. Here, in some modes of this invention, it asks for a 
new radix point, and secondary and the Miyoshi moment using the relation described 
below. 
[0053] 

[Equation 18] 
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and 
[0054] 

[Equation 19] 
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[0055] 

Therefore, the center of gravity, the selected relative die length, and selected width 
of face of the patch for pads are called for using the moment called for by equality 
24, 25, and 26. Moreover, in some modes of this invention, a criteria object is 
embedded in the form of a key on an image or the video frame 45. the physical radix 
point of media is formed, and the level of safety and robustness is raised further. 
[0056] 

It is considered that the relative reinforcement of the specific color of a movie is 
one kind of a digital representation field like the time domain of the movie, a space 
field, and a frequency domain. It is considered that each quadrature encoding 
showing each color or a color is the digital representation field where movies 
differed, the digital representation field where movies differ, respectively can boil 
each quadrature encoding showing each color and a color etc., respectively, it can 
be set, and a watermark pad can perform it according to an individual. 
[0057] 

The image 50 with which patches A1 and A2, A3, and A4 were chosen as drawing 8 
for watermark pads is shown. Selection of a patch location and the number of 
patches is performed by the standard approach, and may follow an algorithm with a 
well-known "patchwork" algorithm etc. However, in some modes of this invention, 
patches A1 and A2, A3, and the location and configuration of A4 are determined 



using one mode of the approach shown in drawing 9 . 
[0058] 

As shown in drawing 8 and drawing 9 , specifically, the criteria object 50 in the 
undistorted subject-copy image 45 is determined using a private key K (100). Then, 
for example, the center of gravity for criteria is searched for using the relation 
described in the form of equality 24 (102). Furthermore, for example, it asks for 
secondary and the Miyoshi moment using the relation described in the form of 
equality 25 and 26 (104). Furthermore, using a private key K and the subject-copy 
image 45, the patch configurations A1 and A2. A3, and A4 are calculated (106), and 
patches A1 and A2, A3, and A4 are generated according to primary t said / which 
was called for ], secondary, and the Miyoshi moment (108 {that is, it asks for the 
parameter of a patch of a location, magnitude, a configuration, etc.)). Furthermore, 
watermark W is embedded using the patches A1 and A2, A3, and A4 which were 
generated (110). 
[0059] 

It is possible to perform a decryption with the equipment which knows the private 
key K. That is, as shown in drawing 10 , it spaces with a private key K, and is 
attached, and a criteria object is computed using an image (1 12). Then, for example, 
the center of gravity for criteria is searched for using the relation described in the 
form of equality 24 (114). Furthermore, it asks for secondary and the Miyoshi 
moment using the relation described in the form of equality 25 and 26 (116). 
Furthermore, it spaces with a private key K, and it is attached, a patch configuration 
is searched for using an image (1 18), and this patch configuration is corrected 
according to the center of gravity, secondary, and the Miyoshi moment for whk:h it 
was able to ask (120). For example, some modes which search for each patch 
configuration using the 2-bit key K define a rectangle using 01 , define a triangle 
using 00, define a circle using 10, and define a hexagon using 1 1. -(Mapping of any 
modes can be set as arbitration and it is not necessary to use the number of the 
same configuration as what was used in this example, or the same -configurations) 1f 
the location and configuration of a patch of A1 , A2, A3, A4, etc. are searched for, it 
will be spaced and attached and digital watermarking will be decrypted from an image 
(122). 
[0060] 

In some modes, a private key K is transmitted to a decoder through a safe -channel. 
For example, a private key K is held, and the owner of contents may use it if needed 
and may investigate the copy of a movie it is supposed that was infringed. In some 
modes, a decoder may be mounted only in a contents owner's machine and Key K 
may be stored in the form enciphered by the equipment or other -equipments. It is 
good even if usable in a key, when a contents owner is a decryption. In some modes, 
the private key K includes information, such as the discovery approach for [ for 
criteria ] criteria, and/or other information. 
[0061] 



It can extend to two or more movies and animations easily, and the approach shown 
in drawing 9 and drawing 1 0 can be made to apply to them so that it may carry out 
in some modes of this invention. The movie distributed to a digital type performs the 
mode of the pad processing shown in drawing 9 which embeds about 50-bit 
watermark in the image of a movie at "the time of a show." Two or more image 
frames are used for embedding all 50-bit watermarks in many modes using 3D pad 
technique (two dimensions are the spatial dimensions of the pixel of an image, and 
the 3rd dimension is time amount) of this invention {that is, a 50-bit watermark is 
distributed to two or more image frames). Therefore, in the mode of a corresponding 
decoder, the embedded watermark is extracted by analyzing a number of image 
frames which correspond at least. The identification number of a meaning showing 
the location of the theater where not only a bit but the movie which specifies the 
show time according to individual of a movie is shown, and the serial number of the 
meaning of the equipment used for showing a movie may be contained in these 50 
bits. When the movie under show is recorded on videotape unjustly (or that is not 
right, either) with the video camera which the visitor and the operator of a projector 
carried in in the movie theater, on the movie Loss of resolution, color migration, 
rotation (for example, a camera is because it is not held at the same include angle 
as a projection screen). Scale change <for example, whether the movie recorded on 
videotape is burying the whole frame of a videocassette recorder) To the frame size 
of a recorder, too greatly Nonlinear distortion <For example, the screen of a movie 
whose visual field of a video camera is not flat appears from the include angle of a 
video camera, and/or does not suit the focus of a video camera of a movie screen 
completely) etc. — a certain distortion may occur. However, the mode of various 
watermark decryptions has the resistance using the approach shown in drawing 10 
over such distortion, and it can ask for a watermark immediately by inspecting the 
video recorded on videotape unjustly. (A time amount modulation component brings 
about resolution loss and the resistance over color migration.) When the video 
recorded on videotape unjustly is analog format, before a decoder's decrypting, a 
digital chemically-modified degree is performed. 
[0062] 

The approach shown in drawing 9 is generalizable to other watermark -grant modes. 
For example, as shown in drawing 8 and drawing 1 1 , from the subject-copy image 45, 
it asks for a criteria object (124), and the center of gravity is searched for (1-26), and 
it asks for secondary and the Miyoshi moment (128). Using the center of gravity and 
the moment, and the subject-copy image which were called for, the pad location and 
reinforcement of a watermark are chosen <130) and a watermark is embedded -by the 
selected location and reinforcement (132). 
[0063] 

Except that the decision of a patch configuration and the decision of a patch space, 
the decision of a location becomes common and a watermark is decrypted from the 
location of a watermark, a decryption is performed like drawing 10 . As shown in 



drawing 12 , it is spaced and attached and, specifically, a -criteria object is called for 
from an image (134). Furthermore, the center of gravity f or criteria is searched for 
(136), and secondary and the Miyoshi moment are called for further "(138). It spaces 
with this information, and it is attached, and from an image, a watermark pad location 
is called for (140) and a watermark is decrypted (142). 
[0064] 

Moreover, the thing which this decryption processing searches for for the location 
for [ in the video frame of a movie ] criteria, It asks for the center of -gravity, the 
second moment, and the Miyoshi moment for criteria, The watermark location known 
in the distance of a movie is traced using the distance adjusted according to the 
location, its center of gravity, the second moment, and the Miyoshi moment for 
criteria, And it can explain also as decrypting the watermark which was traced using 
the distance by which adjustment was carried out [ above-mentioned ] and which 
spaces and is in a location. 
[0065] 

In various modes of this invention, some examples of the class of distortion which 
can respond are shown in drawing 13 , drawing 14 , drawing 15 , and drawing 16 . 
[0066] " 

As shown in drawing 13 , since a radix point 50 is traced like a reference direction 
52 on the basis of the object in an image or the video frame 45, in various modes of 
this invention, the location of patches A1 and A2, A3, and A4 is not mixed up by the 
rotation distortion of an image 45 (in this example, it is 90 degrees at a clockwise 
rotation to drawing 8 ). Therefore, the location of the patches A1 and A2 of system 
of coordinates with which the center of gravity was adjusted, A3, and A4 is eternal 
to rotational transform. 
[0067] 

In drawing 14 , an image or the video frame 54 is reversed and-(56), reverse image, 
or reverse video frame 54' is generated. In various modes of this invention, since a 
radix point 50 is traced on the basis of the object in an image 54 like reference- 
direction Rx-> and Ry->, the location of patches A1 and A2, A3, or A4 is not mixed 
up by this conversion. Therefore, the location of the patches A1 and A2 of system 
of coordinates with which the center of gravity was adjusted, A3, and A4 is eternal 
to rotational transform. A reference direction is called for using the above- 
mentioned moment. 
[0068] 

In drawing 15 , the image or the video frame 56 is applied to the distortion 57 to 
which a dimension is made to reduce along with reference-direction Ry->. this 
distortion — image 56' — the inner patches A1 and A2, A3, A4, A5, and the 
configuration of A6, A7, and A8 are distorted. However, since the system of 
coordinates to which the center of gravity was adjusted are eternal to this 
conversion, in various modes of this invention, a decryption is attained normally. 
[0069] 



In drawing 16 , the image or the video frame 58 is applied to the distortion "59 to 
which a dimension is made to reduce along with reference-direction Ry->. this 
distortion — image 58' — the inner patches A1 and A2. A3, A4, A5, and the size of 
A6, A7, and A8 are smaller than anticipation. However, since the system of 
coordinates to which the center of gravity was adjusted are eternal to this 
conversion, in various modes of this invention, a decryption is attained normally. 
[0070] 

Some modes of this invention include both voice vision watermark-ization. 
Concretely, the digital movie is usually equipped with both the vision channel and the 
voice channel. Both a vision channel and a voice channel can be used, it can space 
with robustness, and a watermark can be embedded according to the trade-off 
between pad ability. For example, in some modes of this invention, a watermark is 
embedded at both a voice channel and a video channel using the time amount 
modulation shown in drawing 4 . In some modes, a partial watermark is embedded 
synchronous at a voice channel and a video channel, or a robust watermark is 
generated to geometric distortion by embedding a synchronous mark at both a voice 
channel and a video channel. 
[0071] 

As shown in drawing 1 and drawing 17 , in order to prevent the alteration of both the 
trucks aiming at illegal distribution in some modes, [ whether while generating the 
digital signature 64 of the data of the vision stream 60, this signature is made to 
embed at the voice stream 62, and ] Or so that this signature may be made to 
embed at the video stream 60 or those both may be performed, while generating the 
digital signature 66 of the data of the voice stream 62 The time pad block 24 and/or 
the frequency-domain pad block 34 (and/or, still more nearly another field pad 
block) are constituted. The data with which it spaces, and it is attached and the 
bona fides of the voice channel of a digital movie and/or a video channel are 
acquired by this are embedded. In some modes, as two or more data blocks of one 
stream are used and it is shown in drawing 17 , it can ask for the signature which is 
delayed slightly and embedded at the stream of another side. This delay can be 
reduced or removed if pipeline processing is used. In some modes, it can respond to 
a pad with a quick signature by using a continuous data stream which serves as a 
checksum generation machine. The detail of the operation about a suitable digital 
signature generation machine can be found out to U.S. Pat. No. 6,456,726 besides 
you (Yu) which is incorporated in this specification in the form of a citation as it is 
and which was delivered on September 24, 2002 under the name of "the multilayer 
data concealment approach and equipment {Methods and apparatus for multi-layer 
data hiding)." 
[0072] 

In the case of the movie (for example, many bits can be made to store in per £ of a 
movie ] frame with "just-noticeable-difference" function) which has high data 
concealment capacity, in some modes of this invention, digital watermarking is 



embedded many times at the segment from which a host video stream differs in a 
field different, respectively, respectively using the various approaches of embedding 
which raise the processing noise of various classes, and the robustness over 
distortion. 
[0073] 

Since a digital movie may be distributed and saved in the state of compression and 
the watermark grant approach of this invention is performed during playback of a 
movie, in many modes of this invention, the pad processing which can be performed 
on real time is used. 
[0074] 

Movie data [ finishing / compression ] are made to memorize beforehand in a part of 
pad processings which can be performed t real-time ] using a buffer. "For example, 
two groups or two shots (namely, the movie were shot without interruption with one 
camera or two sequences of a TV program) which consist of ten images are 
memorized by the buffer just before playback. Then, the 2nd image group or the 2nd 
shot is processed, and the watermark corresponding to it is embedded during 
playback of the first image group or a previous shot, at least one voice of this 
invention — it is [ as seeming / it / that it sets like and comes out so ] also 
possible to use three or more buffers or to use a circular-buffering system. For 
example, in some modes of this invention, as shown in drawing 18 , the buffer 37 is 
further formed between the frequency-domain watermark pad module 44 of drawing 
1_ , and the digital theater display 40. 
[0075] 

In some modes of this invention, in order to carry out a real-time pad, a watermark 
is embedded directly at compressed data. For example, data are embedded in a 
frequency domain using the suitable conventional frequency-domain pad technique. 
In another example, data are embedded to a quantization characteristic. In the mode 
of such many, image restoration includes a decryption <for example, Hoffmann 
decryption), reverse quantization, and frequency-space conversion. The decrypted 
quantization characteristic is modulated in one of the high-speed pad techniques 
used in some modes. Each characteristic is computed after a decryption. When being 
changed is desirable (that is, human beings, such as just noticeable difference and a 
JND function, are smaller than the threshold from which it can discriminate in 
consciousness), the number of a characteristic is modulated by changing one or 
more steps of quantization so that the single bits 1 or 0 may be embedded. In the 
mode using an odd number-even modification algorithm, one of the quantization 
steps is the amount of the maximum modification. Therefore, when the number of 
phases of quantization is even, quantization is changed and it is made to make it 
increase or decrease by one step, in order to embed "1." By inspecting the 
characteristic of in front of a current characteristic or an immediately after, a 
reduction step or an increment step is adapted so that the artifact which may be 
generated by the difference between a current characteristic and its neighbor may 



be made into the minimum. In the mode which uses a modulo watermark algorithm, a 
single bit is embedded using a characteristic sequence of numbers by [ to which the 
combination of a characteristic sequence of numbers becomes a desired value {for 
example, the sum of a total characteristic becomes even number, or becomes 
smaller than another larger and predetermined number than a predetermined number 
using a look-up table) ] changing the characteristic of one or more pieces like. 
[0076] 

Furthermore, the thing for which some modes of this invention are the approaches 
of embedding digital watermarking on a digital movie, and a part of electronic digital 
representation of a digital movie is temporarily stored in at least one digital 
representation field, By embedding the whole digital watermarking once [ at least ] 
at at least two channels (a vision DCH, a voice DCH, alphabetic character DCH, 
etc.) of the digital representation of the above-mentioned movie Digital 
watermarking is embedded to at least one stored digital representation field of the 
above-mentioned movie, The above-mentioned watermark stream containing the 
main watermark data and auxiliary (or for control) watermark data {synchronous data 
etc.) is divided into a partial watermark bit stream {watermark segment), {Time of 
day, location, etc.) Each partial watermark bit stream is embedded at the segment 
from which the above-mentioned digital movie differs, respectively, At least one of 
the above-mentioned partial watermark bit streams is embedded to at least one 
digital representation field using at least one time human-being vision model. It has 
embedding the above-mentioned partial watermark bit stream and showing a part of 
above-mentioned digital movie during generating of the above-mentioned pad using 
at least two different watermark algorithms or schemas. 
[0077] 

Therefore, it is robust to distortion of various classes expected about the movie by 
which the mode of this invention is recorded on videotape at the time of a show at a 
digital theater, and is reproduced unjustly, and it is clear to offer a tolerant 
watermark pad. If such a movie recorded on videotape is seized, ****** analysis of 
it can be carried out at distortion introduced, and it can ask for the location and 
show time of day when the justification of a movie and/or its image transcription 
were performed. These analyses can be performed regardless of whether it is 
distortion which originates whether it is distortion which originates whether it is 
distortion resulting from an image transcription device in digital to analog -conversion 
in analog-to-digital conversion. 
[0078] 

Furthermore, that it can improve further could also understand the robustness over 
distortion, and resistance by using the various watermark embedding approaches 
indicated by this specification in the form of the combination which may be mutually 
[ individually or ] compatible. 
[0079] 

It has the intention of the deformation which does not pass over explanation of this 



invention to instantiation in essence, therefore does not deviate from the main point 
of this invention with what belongs within the limits of this invention, it should not be 
considered that such deformation is deviation from the pneuma and the range of this 
invention. 

[Brief Description of the Drawings] 
[0080] 

[Drawing 1] Drawing 1 is a block diagram showing the equipment which performs a 
multilayer watermark of a digital movie, and various modes of an approach. 
[Drawing 2] In some modes of this invention, drawing 2 is a graph showing watermark 
weight gamma (t) added during the shot period of a movie, when one shot of a movie 
consists of very short frame trains. 

[Drawing 3] In some modes of this invention, drawing 3 is a graph showing watermark 
weight gamma (t) added during the shot period of a movie, when the shot 
corresponding to the short shot of drawing 2 consists of a frame train longer than 
drawing 2 . 

[Drawing 4] Drawing 4 expresses the data stream by which the back before a 
watermark is given by the time amount modulation was divided. 
[Drawing 5] Drawing 5 expresses the easy image for [ by the conventional 
"patchwork" encoder ] watermark grant. 

[Drawing 6] Drawing 6 expresses the image of drawing 5 with which the patch 
location used in the typical example of application of the conventional "patchwork" 
encoder was chosen. 

[Drawing 7] Drawing 7 expresses the image which has the patch location which the 
conventional "patchwork" decoder takes, although the image shown in drawing 5 is 
rotated 90 degrees. 

•[Drawing 8] Drawing 8 expresses drawing of the undistorted condition which shows 
the patch for watermark pads. 

[Drawing 9] Drawing 9 is a flow Fig. showing the various approaches of this invention 
which forms and uses the patch for watermark pads. 

[Drawing 10] Drawing 10 is a flow Fig. showing the various approaches of this 
invention which traces and decrypts the watermark embedded using the mode of the 
approach of embedding shown in drawing 9 . 

[Drawing 1 1] Drawing 1 1 is the flow Fig. showing the watermark grant approach 
which generalized approaches other than the patch pad shown in drawing 9 . 
[Drawing 12] Drawing 12 is the flow Fig. showing the watermark grant approach 
which generalized approaches other than the patch pad shown in drawing 10 . 
[Drawing 13] Drawing 13 is drawing which introduced 90 rotation distortion into the 
image, when a criteria object is found out on the basis of the object in a drawing. 
[Drawing 14] Drawing 14 is drawing which introduced reversal distortion into the 
image, when a reference direction is found out on the basis of the object in a 
drawing. 

[Drawing 1 5] Drawing 1 5 is drawing which introduced nonlinear distortion into the 



image, when the location and configuration of the patch for watermark pads are 
found out on the basis of the target center of gravity. 

[Drawing 1 6] Drawing 1 6 is drawing which introduced scaling distortion into the 
image, when the location and configuration of the patch for watermark pads are 
found out on the basis of the target center of gravity. 

[Drawing 17] Drawing 1 7 expresses the mutual pad of the signature between the 
voice stream of a digital movie, and a video stream. 

[Drawing 18] Before drawing 18 is spaced and attached and shows a movie, they is 
some block diagrams of drawing 1 showing the modification in which another buffer 
which stores the shot of a movie temporarily was formed. 
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[Brief Description of the Drawings] 
[0080] 

[Drawing 1] Drawing 1 is a block diagram showing the equipment which performs a 
multilayer watermark of a digital movie, and various modes of an approach. 
[Drawing 2] In some modes of this invention, drawing 2 is a graph showing watermark 
weight gamma <t) added during the shot period of a movie, when one shot of a movie 
consists of very short frame trains. 

[Drawing 3] In some modes of this invention, drawing 3 is a graph showing watermark 
weight gamma <t) added during the shot period of a movie, when the shot 
corresponding to the short shot of drawing 2 -consists of a frame train longer than 
drawing 2 . 

[Drawing 4] Drawing 4 expresses the data stream by which the back before a 
watermark is given by the time amount modulation was divided. 
[Drawing 5] Drawing 5 expresses the easy image for [ by the conventional 
"patchwork" encoder ] watermark grant. 

{Drawing 6] Drawing 6 expresses the image of drawing 5 with which the patch 
location used in the typical example of application of the conventional "patchwork" 
encoder was chosen. 

[Drawing 7] Drawing 7 expresses the image which has the patch location which the 
conventional "patchwork" decoder takes, although the image shown in drawing 5 is 
rotated 90 degrees. ' 
{Drawing 8] Drawing 8 expresses drawing of the undistorted condition which shows 
the patch for watermark pads. 

[Drawing 9] Drawing 9 is a flow Fig. showing the various approaches of this invention 
which forms and uses the patch for watermark pads. 

[Drawing 10] Drawing 10 is a flow Fig. showing the various approaches of this 



invention which traces and decrypts the watermark embedded using the mode of the 
approach of embedding shown in drawing 9 . 

[Drawing 1 1] Drawing 1 1 is the flow Fig. showing the watermark grant approach 
which generalized approaches other than the patch pad shown in drawing 9 . 
[Drawing 12] Drawing 12 is the flow Fig. showing the watermark grant approach 
which generalized approaches other than the patch pad shown in drawing 10 . 
[Drawing 13] Drawing 13 is drawing which introduced 90 rotation distortion into the 
image, when a criteria object is found out on the basis of the object in a drawing. 
[Drawing 14] Drawing 14 is drawing which introduced reversal distortion into the 
image, when a reference direction is found out on the basis of the object in a 
drawing. 

[Drawing 15] Drawing 15 is drawing which introduced nonlinear distortion into the 
image, when the location and configuration of the patch for watermark pads are 
found out on the basis of the target center of gravity. 

[Drawing 16] Drawing 16 is drawing which introduced scaling distortion into the 
image, when the location and configuration of the patch for watermark pads are 
found out on the basis of the target center of gravity. 

[Drawing 17] Drawing 17 expresses the mutual pad of the signature between the 
voice stream of a digital movie, and a video stream. 

[Drawing 18] Before drawing 18 is spaced and attached and shows a movie, they is 
some block diagrams of drawing 1 showing the modification in which another buffer 
which stores the shot of a movie temporarily was formed. 
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-flit LT^fflfcJJittfc— SMreidU »*Ui* 2oot^^hW 1 i5i:O f W J 

y Md? hKfrmZtl, Qi = 1 0, Q 2 -Q 1 = 9. Q= 1-0 + 9 = 1 9, q *= [ 
1, 19] > p<= [i, 2]> j e [i, 2] isi^KS t*& 0 i 2 

[0 0 2 2] 

[0 0 2 3] so 



<12) 
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7tv^5 1 6 m^ra^u* h y >^^jg^$^*o 1 oo— aj^sanrii, & 

*£*iJffif&o 8^L7t>r5 1 6 1*, iJSUJ:^:, &tf>£>*tfca^LW£ P^<^ 

-t^* > h-ett^no M-t^> hw P ri $ tb;*j3*i&fc, mtut, h 

W^feffHt*. ±a©-b^>hol«»f, (W q ) iWfca&iu a^L-fe^vh/* 
[0 0 2 4] 

{£3l3*i*:3&fiE<*>f r *r i;^;nff*>fc^ > Mi, > h 1 -8 £ffii£>& 

fro S^L#§*^>Mi, Wxtf, f-f V9)\'}£r*m$&m7*--?v b 

-b^^ > h/ty77 2 8M4ftj(flS*t2, 0 £c<^&2 6*^^36^, J§2fc&a 

^ tffi^** y a - Jl/ 3 4 i C^SM ISM* v ^ - ^ 4 4 fi, m^OT-lV? 

y mc t^>f^7 77is«n (»^m:oTii, asfe3 o 

->'a-;V2 4i:ICl^t-b^^>h ZtlKUlfc-tZ 1 oJ^Ji<^-b^^ > 1- 

y h\zm&teM»t>&$*i& J: i K^ftZH&o LfrLZtfh, z<Dtti&Mmt, 
2»S^tS^TJW^yXASrffl^T> 7* *f v*;V^;*<^*l^ft#|>5:;g>«:^ > h<£> 

x.!*. ffi»WH2^LS8lflt^ffiv^^^ h^tS^L7;^'JXA^ffi^T, + MJS«E 

toft-rrt-y v*i>r* y y ns£>&/k-c*> x ^ c £ *>n/t* M4J5#*«mk fc^a^L-fe^ 
«>ttf, ? h&pi^ofcHioTJv^yxAfcffl^-r^ istjsafeft*^ 

3 4*3 JIM 4"CS*^tfHti. ^KI^J**5 J: tfjgSE&^ifc?) AMtlftfJP 

4 2rtH$/B3*t£<> 3 4 t^^o^, H«afc«WOat*Ltt-S-tf:7* 

[0 0 2 5] 

3 o&±<3ft*-C<o£SS&**#ffi Ljfc V) , 0 1 t^-T J* 

i£JB 3 £ t i>mffiz *t&-<£ -e^^o 

[0 0 2 6] 

n^TC (2D) a^L^A£^£ft#<^^*m^a^L£#.r£, *l&9!o-g&o!B 



(13) 
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mmm.) «u jpeg mm*&m<t2 a x * hzj-m&ftmy*—*? hmva* 
y hy* hy?y<< v?*.**/*- hr^-ymfe) mmr)v=r^ xa & j nd <t 

(ffrfc*,, A£) BftU I '*a*L#g <-T£fc>*>> W-Srjl 
I ' = I + a W < 7 ) 

[0 0 2 7] 

*»w©-as«>si*-c»±, em^f (t) mmilt, juTo^^ioTSBa* 

*L4%*<D2D2^L*PA«#Srffl^Tlf7'*m*f ' (t) fca*LW*!*Ai-*o 10 
f ' (t) =f (t) +«W (8) 
[0 0 2 8] 

iit, \?r*Xt)f (t) 0#7V-Ait 2*L»ft*fMfPT*B«'*-*<*>Ara 
^f^JND (x, y) rct ,*&.&-tZt:ibK&mZtl, J ND (x, y) f(t) lia 

f ' (t) =f (t) +a (J ND (x, y) f<t) ) W (9) 
[0 0 2 9] 

D) j8*L&«S ^frfiOMtt, tr7**2*vLOo^ Mft*iRj±3«fcfc, 

J ND (x, y) tVD (t) £<7>H8&-C&£=:£og <3 D) AW*fJVH VM ( 20 

x, y, t) S-tefflf&o TS:^ra«jAWffi^y';K^^»!«|^ U m^fcTf** 7 V 

fcTIi, T<7)|Sm-^*S [t-/?T, t + (1-/?) T] 7l/-A^ffflU, SWEOtT 



t '= lt-/9T t, . . . , t+ (1-/?) T} (10) 

VD (t) = g (f (t ') ) -g (f (t-j?T) f (t) . . . . 

, f (t + '(1-0) T) ) (1 1) 30 



ttio fiu f (t) isitfg (t) »*> rnjLn, -m<Dm,mr~-?ttztez<D- : &<v 
m&*t*mft&Km$ri-2> zlkx-? xmm ? Kti^^m^m^x^m^ amo 

80t«>ll»M«>3>' h?* 0f;jU T> £ <t) &ZZfg < 

t) t t is^mmz flZXUv-mX'&Zo VD (t) >5^^:VM <t) = l£ffi 

an, **uwvci*vm (t) =vd (t) tm&zti&m&.tt&'r&k, wtce 

& 3 *i& M# £ m v> X M r * K&ri* L W5&*tt-5- S ti& 0 
[0 0 3 0] 

f ' (t) =f (t) + (y (t) X (l-VM (t) ) ) X ( a X J N D < x , 
y) rco) XW (12) 
HU a&J:T} ! dte3.~4ri)miRWm%'*y*-?s a<llil?iRol*i:j|8iL <o 
N y (t) I**— **«»RiM6fct©Ha^** 0 
[0 0 3 1 ] 

*nwo-g505S»Tii, s,*«ifi^->*iitii, *s->&mm&F (W. 

S<) «rfflv^T2^L<^»14Sr? 5»»c|fti±$*a 0 Lt^T, &Tfc3EJ££ *i&fW«* 
[0 0 3 2] 

f' (t) = f (t) + ( r (t) X (l-VM (t) ) ) X (aXJND (x, 
y) ret)) XF (W, Si) (1 3) 

[0 0 3 3] 

mWttajsXVy (t) *IRt4 4^ »*4fflilO»*«:*#i:ftAa^t*J:^ so 
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-T^^mmm^y b^jgii. ql<q& < <os*? * - ? <D*&t>ir. Wj&^t t jv&j^ 

$5 X Xf s y a y «x.lf. 3 oo5tiR-> a >Shotl x Shot2js«fc 

j^Xx^fi, &KttnfRtQ#KMm&&WAKmXZftZT-'f' 4 y t 9 h&®&Ktft 

$&&«ttfcje&v>aj&^a«>&tr£ * 0 u^ot, m^i-i:?^ shot2<^ 

mm^Ky (t) *lCRStiCWIBW), -T^^*>, t erShot2<7)<>;^ y ( 
t) =1-C£*K i3^-f><, a£ 1 J: U*<Rilt4£i^S*. i*LP>OStSgRJ: «9 

%m$ky (t) W^iJlTU. £<0J§<£N |[*JHi«##*fc05^*6\ o 

> &*£#t<7>*-<* hJVj£tfcS^LT;V=f';XAFs sri^, VD (t) = 0>5e&a. 
m^E<07lx— A t^Rlfji <®#^-X?» JND^JND (x, y) fcfflffl LT, 

f ' (t) = f (t) + y (t) XaXJND <x, y) t XFss <W, S,) 

(14) 

[0 0 3 4] 

u^ot, m i n^-r «t mmKm-rmM*?. mmmrn 1 o K.mmz*i&**s 

jl-)1<2 4 % ?<Dmm&)&frLM&fr*-y frit, ^5£l 2KfE&3*lfcllS«£rf:*igs 
°[0 0 3 5] 

n^WTSi, Ts, T s N &;rr&Nl®<D4r^ > h S x , S 2 , . . . , 

S„K55-t!l£ft&o {BU Ts=Ts 1 + Ts ! + . . . +Ts N ^l, Vs, = Vt s) + 
Vt SJ t$.>), S q e [ l , Q] , St*5«t^Sj e [ l , S«] -C&& 0 fllx.tf, 
H*^<fl-«it «fc 19 v \£T*Z h 'J-A4 l30 s ->a v Ym&4 > Mfc3*U 

47*74 >S?)-b7> > F^?7 7 2 2j& s ^U^ffl<7) l^<^)->3 ? tztt*ty* y 

hSi, S, S H £te*ft1-&£ fcKft* 0 »*L,#-5-lfctt, ^Ltt^T*:** 

h'J-A4 1 '<D*?*Z'YS '1, S' 2 S ' n<0-&<Q&mMM*K #-5-$ 

Jti&^Lfci&C*^ Ilff^^ h U -A 4 l^L©4l/^^^ y Y Si, S 2 , . . 

(0 0 3 6] 
[0 0 3 7 3 
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[»10] 



dl 



A = kDT sb k 



T 



(15) 



dK 



10 



[0 0 3 8] 



b-T&o Ts,<Ai3«J:CFw=lc7)t| £% T's f =Ts 1 +AT, T ' s j=T s, - AT 
T ' s^itii, — T Si >A*3«fcO f w= 0<7>t T ' s, = T s t - A 
t, T ' 8 j=T Sj + A t -C^> *K T ' s,^At*S, , V's q =V3,+ 

wtftkmziri&o £*>«TMi, ! /B7MI (^F^iM) K.^<^p$r^ijfflLTi'|@<7) 
[0 0 3 9] 



isZZft =A-T s, Lfcj^oT, w= 1 L t? y V &Mtbjktt tub. 



[0 0 4 0] 
[&1 1] 



* - {/V / a. • = {/ea_, j _ 1 .W\+1,/e*_ 1> ,_ 1 UM, ... f t 



j_! uh+m} (16) 



[0 0 4 1 ] 

mi 2] 



30 



m= £ AfA + Afi + ts t + ltoJI/ 



(17) 



[0 0 4 2] 
[&1 3] 




40 




f 



(1 9) 



[0 0 4 3] 
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mi 4] 



m€ X) Mh + l, £ Mh+Mj\, (20) 



[0 0 4 4] 
[ftl 5] 



/m8Ss/ ^(-=^-.^) ; (2 ° 



[0 0 4 5] 
[tl6] 

m= 5^ Mfc + Mi + lto J2 ilfh + Mt + tst, (22) 

[0 0 4 6] 
Mfc 1 7 ] 

'fm- fum «~ l '?'* m L>t-m + £ Mfc + Afi + lV (23) 
[0 0 4 7] 

(3D) M&fr<DWi&, at* LIT? Mi, ttHotTr'*^ h 'J-A^^Bft7W A 
[0 0 4 8] 

(i^PJ-Cli. ;fe±RS<7)II*) h dS^Ltr -7 >«&*ffl<7>^&<7V^?H£mA 1 . A 2 
„ A3^iU J A4 Sr^T &o m 6 M* 4 6 /t? ftif A 1, A-2 

, A 3£ JtfA 4#fr*oTV>£^*Lm^fc*i^~JWi. ®«Sfclitf7**7V-A 

[0 0 4 9] 

»9tC9 0jg®i|£$-££*t& @7t:/7tJ:?i:, rt: fitTr** 7 V- A 4 S <a£± 

*4 fcffiSSU A'yftiA 1 A2 A3 'fei -CF A 4 LS&*ffl4Em-e 



(17) 
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[0 0 5 0] 

£ fcm-t &o MM * > h Sr JB » xmm «* tf/ * tz i± JB4KtJ-8c* flwrr * * 5 Ml 
[0 0 5 1 ] 

{&<DmR&mk-rzk, zixKmcx]&tiL&2<DmRi>mt-r2><D-e^ m^a*»u*3p* 

[0 0 5 2] 

dA=dxdytU ^ (a,) a , <9#5e<afe(Offi#W»j£i: U yi £B«<a 

[0 0 5 3] 
[ftl 8] 



^o = ±^~(*o,1to) (24) 



V 



[0 0 5 4] 
[%191 

(26) 



[0 0 5 5] 
[0 0 5 6 ] 



(18) 
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[0 0 5 7] 

@8i:, l^LaMi:^'7f-Al, A2, A3*5itfA4;*«aMR3*LfcB«5D* 

»i, /<?fAi, A2, A3&£V!A4<Dfcwtm£it. m9KKttm<v-mm&m\<> 

[0 0 5 8] 

£**hft5 0*fcS£T* (10 0) o #^2 40^T|Ba$*t^M«* 

MmLX&mttML<0&fc*$i*>*> (10 2) o 3<=>fc> ffij&tf, ^$.2 5&*V ! 2-6<DJ& 

xm&2titzm%*m%Lx > (104) 0 a>h^. m 

&m¥Lk £ffi&4 S*m^X, sty+J&VlA 1, A2, A 3i3i V s A 4 (10 6) 

. Itrffrfc^fctlfc-:^ — i&fcJltfH**-,* > MC&oT. A'yfAl, A 2. A3i3 

) (108)o HC, £.$LZ1riti/*v?-A 1, A2, A 3 £ J: A 4 SrfUffl Lt, 
LW*S*!>&tf (110), 
[0 0 5 9] 

1 2) o fO^, ^2 4<&^ffi&S*ifcM«4fr*0fflLT. 

(1 14) o #5£2 5*3itf 2 6<*>^ffi&S*Lfcl»«*f!Jfl3 u> 

£J:t>*H:£:-=e~;{ > f££*?>;& (l 16) « ?£>K, 8af«Ki8^U##i*i *fOffl 
lT^9f^S:*if) (118) > CO/^y^JlM**, 3jt«>e*tfcm^t-^*i:V=^ 

*-^>n:itoTjim (i 2 o) o mm*, 2e^^sK^K#^« 

) Al, A2s A3. A 4 f O f ^)ffif i f, i , ^Ltt§® 

fcfrhm.^&frLTbm^tZtlZ (12 2) o 
[0 0 6 0] 

*u *<Dmm* * i^^fi^Rt -^fts *t*:^-r«KjWfrim ? nx^x <> 

[0 0 6 1 ] 

«>$#*:&fr*-&o 3DS&*&flj (-oo^5c«iffi«<0®3K^M«-t^-C*«J^ f£3 
afc&fr^K 2#^±^>®«7 (i-fcfr*,, 2#J^±<7)iS^7^-A^5 
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ef^a^otBsa^ffi-efc^ i&®?>;** y t***;* 

[0 0 6 2] 

su^vai i ? n«45^^ mmttm**tb <i 2 4) , ^©i^ 

(12 6) , fit, zi^'J:lfH^-^ > h (12 8) o iSCtb^fitzM. 

hb&M*k*m^X, &frL*>M&&®:mk%imZmiRL (1 3 0) 
, MR2ilti&W.k%im.X*&frL*Mit>&tt (13 2) o 
[0 0 6 3] 

m^Ltm^t^fi^^m^ mi okmmzLx&^ittf&fTZtiZo h 

12RgfJ:^:, S^L#iM^A,^M^*i6P>n^ (1 3 4) 0 £i£ 
^<^M^**?)*t (13 6) , $<bK> -^J:^*-^ y }>&$itt>htL2> (1 
3 8) o £<0te«fc»*Lft§H«*:j&>&, 2^LaMtt^*4.*L<14 0) , S 
^L^-^-ft$*L& (1 4 2) o 
[0 0 6 4] 

[0 0 6 5] 

fci^c j3V>T#OT£gfc^*<^^m* < o*s>ffcSrBI 13,114, 
IS 1 5 is J: 1 6 i:^f 0 
[0 0 6 6] 

SI 3 *8Mrcii, 1^5 0^, mi5 2^#«K, 

m&ttz&lfT'* y V- A 4 5l*I<7)^^^lcLT^ijli*^tL&<^^, ®&4 5<Oi 

(ci^^-cji, ms ^MLxmm*)X9 om kx^x, a-^ak a 2, a 

yfAl, A 2, A 3 JsJrtfA 4<Dtemii, LT^-C*4 0 40 

[0 0 6 7] 

H14-CI4, I«l/ditf^7l/-A5 4^?tLt (5 6) , ®|SB«i>b«R 

i^^icTA'yfAl, A 2, A3$tzi±A4<7>tiLW.tfMffl2tl&£lki±ti:^o L 
fc^ot, S^HSESJtfcffiai^O^^^A 1 , A 2, A 3 £ J: tfA 4 Oft:®!*, M|k 

[0 0 6 8] 

®1 5-e»i, m&*tztt\£7**yU-J*5 6i!)K &&?yftR y^K&vX 
*£S*5 7C^tf)*lTv^o *K i«5 6 'WO^fAl, A2, A so 



^20) 
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3> A4, A5> A6> A 7 & X VA 8 (DWttktf&AsX^Z 0 L^L4**fe^ B^mm 
[0 0 6 9] 

-£&g*5 9 lC3Ht£*LTV*£ 0 V) „ Hit 5 8 ' t*l A 1, A 2 , A 

3, A4, A5> A6, A 7 J3 J: V s A 8 X^#,«fc V) *>/h3 < ft o T W£ e L^L 

*TNt «^-fk^jE«H3^$*Lft 0 
[0 0 7 0] 

BSIt iiHT, v ^^JKOW^Srfix.Tv^o Ultf- V > * >ui * 

&«T«t , ir > * A> t tf f- ■* > * JW:: ITOl$iw*B53-&^ i *) , 

[0 0 7 1 ] 

-S&oS8*-Clt Hl^iCfHi 7^TJ:?tc, igteftSMfr* i»it£M J< 7 y * 

-^tV V9)l>%%> & 6 £&j£1-;i>££ ^^Hf^-T, h V-^ 6 OKCL<75^ 

2>&vMi^<7>W:fr£fr ? «£ *> ^MWffi^^rcr >y ^ 2 4 £ <fc 0*/ 1 tzitm 
y?34 «fc OV 2 1*3 f> fcJfflO«J*«&*7*o 7 ? ) sWgft ? 

<7)W.$k<7>T f% - 9 >^o -7 ^ Sr^Uffl B9 1 7 K^-r «*: 0 t3~ffrKM%kLXi&~}3<D7> h V 

<Dl&-?m >9 & * > \^mr- ? B§jg:fri&i3 <fc ^©{Methods and apparatus for mul 
ti-layer data hiding)J ^t"C2 0 0 2^9^2 4 0 K3ZitZ tlfc 3.- CYu)4feO#S| 
#frS6, 4 5 6, 7 2 6fi:iaitut*5-e|l. 0 
[0 0 7 2] 

[0 0 7 3] 
[0 0 7 4] 

im<D%* ?x*m% <WL&2tifz&m$tz\*Tis£&m<D2m(oi'->!r>x) 



(21) 
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y T*i$.m-t2>z.k, ^>*l/Mit-^a7-^ , ; 77'J > ^v^r a «bBr 

3 7^IS:tt^^TV^ e 
[0 0 7 5] 

if^f^OloiiiMIi^?), Lfc^oT, TlJ fi^tt: 
[0 0 7 6] 

, ->'^;v8!fcM<^m^7 :y 'f -y^^mo— 95*4?* <t'fci o?>tW -y* >v£3&flB*-c 

£ & 1 mS^&tfdiK^oT. ±feefeiS<7)4»5r< 1 o<7)*&*fl.$ ftfcf* 

fr^Ltfy MJ -A m&L-ty*> h) ic^itiii: ^gP^S^Lkr^ h 

& 1 o£4?&< £ l 0^)7*^ v*JV^<mi#KS*!>&ifC:fc t> ^<ii2o^/ 
&i£^LT;v^';XA£fcl*;**--v£fflv>T. _hf£§&#Sri>Llfy h 'J -A£ffi# 

&o 40 

[0 0 7 7] 

Ji^-r^Cifc^^^^-C^&o ^-<7)J: 9 4fi®-3*ifcttHti\ ftUKSft&i. ^A?ttT 
[0 0 7 8] 



(22) 
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l 3 ) &®.&*£<DM-emm-r&ztK3:vi:mfrKtt-rz>u,m M4^wttsr? hwto±-e 

[0 0 7 9} 

[HMOl^*!^] 
[0 0 8 0] 

[12] H2(4, *%>W(0-ffi<nmmK&^X, ^I^l'>3rh^ti:^7V-A 

[03] 0 3li, #3&^£>-$&<7>31*§Mci3V*T, m2V>m^i'3 v hKftJ&-?&z/ a v ^ 

(t) *^-r^7-7^& 0 
[H4] H4(4, ^H^PJiJ:oTS^t* s ##^tL&mtm^ifl?tt7t:T'-^^ h l) 

nasi H5«, o?y*-y-*j 3rf#»K**a^L4t-^jw*ott*arB«*a 

[H6] H6(4, r^y^V-^J &-%&<7>MM&i%&mMK&\,*Xtiim$fL&s* 

v f - & w # s s *l h s <r> m ft £ o 
lias] eisit a^L«a*ffl^y^«rwi-*RS*ttjR«>ia**-r. 

[19 9] H9(4, a^t«a*ffl^y^«r»*LT«ffl-r**»WO*/r**ifc*fE-r7 

[HI 0] Hi 0(4, H9^i-a2t*^w»#«rfllfflLT«*&4*Lfca^L*^ 

[Hi 1] HI 114. Hg^i-^y^aa^^O^ftSr-aMklxfc, it^L##7J*fc 

[HI 2] HI 2(4, HI 0^*i-/'«y^aa*Jttnfl!>*tt4r-Jttfl:Ufc. 2a*U*^ 

[HI 3] HI 3(4, £9^B9i8Ao^i<«2: LT tiS^fc, ®ftfc 9 
0J&?)II!if£^*£3itA U:MJ, 

[HI 4] Hi 4(4, ^^fp]* s HffiW(7)^-^^^^LTMai^^^^, Mftfc-R 

* * «c A L H -C £ & o 
[Hi 5] HI 5 14, a^L«jL*ffl^^^^tt*^^*«#*^m^*rJf**:LrAflB 

[HI 6] Hi 6 (4, &frLMiL&ms*v^<Q&WtJ&&tim&<vn'b&&mzLX&m 

[Hi 7] HI 7(4, y^HftjBO^* Y 'J-At lff*X h U - AOKt(Of^ 

[HI 8] HI 8(4, a^L#&ttiiiSr±lft-ratir^lftS^>->a y h-Sr— l^WtjftJBra 
fljev** "7 rrtWt£*t*:«£M£^-rH 1 <7)^n^ ^H(7)-^-c^s 0 
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II] 



V- 













\ ** I 



a*»L I -18 



rassca 



ssra. Hsejs 



[12 3] 



4* 



4=4. 
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[12 1 0] [111] 




C26) 3P 2004-159309 A 2004.6.3 

117] [M 1 B ] 



V 



_1 S 

Tlr 



v-y-r' 



r 
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7J')*'&mm -^-isv-ls-jW 0 85 50. i/f>4?^a>, U 

T^V*^H 08536- 1 952, ^U^>X#D, F-5 

V 39 

F£-A(#3*) 5B057 AA20 CA01 CA08 CA12 CA16 CB01 CB08 CB12 CB16 OC01 

CE08 CCO 5 

5C053 FA13 CB06 CB21 JA03 JA21 

5C063 AB03 AB05 AC01 ACLO CA36 QM3 

5C076 AA14 BA06 
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